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Abstract 

We study in detail the sensitivity of neutrino oscillation probabilities to the fundamental neutrino 
parameters and their possible determination through experiments. The first part of the paper is 
devoted to the broad theme of isolating regions in the neutrino (and anti-neutrino) energy and 
propagation length that are sensitive to the oscillation parameters. Such a study is relevant to 
neutrinos both from the Earth's atmosphere or from a neutrino factory. For completeness we 
discuss the sensitivity, however small, to the parameters involved in a three-generation framework, 
and to the Earth matter density profile. We then study processes relevant to atmospheric neutrinos 
which are sensitive to and allow precision measurements of the mixing angle #23 and mass-squared 
difference $32 apart from the mixing angle #13. Crucial to this analysis is charge identification; 
detectors having this capability can isolate these matter effects. In particular, we address the issue 
of using matter effects to determine whether the mixing angle #23 is maximal, and, if not, to explore 
how well its octant can be determined. When realistic detector resolutions are included, we find 
that deviations of about 15% (20%) from a maximal value of sin 2 #23 = 1/2 can be measured at 95% 
(99%) CL) provided #13 is non-zero, sin 2 #13 > 0.015, and the neutrino mass ordering is normal, 
with fairly large exposures of 1000 kton-years. 

PACS numbers: 14.60.Pq, 96.40.Tv, 95.55.Vj 
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I. INTRODUCTION 



Observations of solar, atmospheric, reactor and long-baseline neutrinos have provided 
compelling evidence for neutrino oscillations |H, 0, IE 0] ■ m ^ ac ^' the latest analysis of the data 
from the Super-Kamiokande (Super-K) collaboration |j| presents a clear and unambiguous 
evidence for the oscillation hypothesis |E 0] by establishing the first oscillation minimum 
and hence for non-zero (and different) neutrino masses and mixing. In the meanwhile, the 
Sudbury Neutrino Observatory (SNO) [l| has provided incontrovertible evidence for neutrino 
oscillation from solar neutrino data. 

Clearly neutrino physics is now entering an era of precision measurements. The focus from 
now on will be to precisely determine the oscillation parameters apart from the observation 
of the oscillation pattern beyond the first minimum. Given the reach of present and proposed 
experiments, the goal is to understand in detail the sensitivity of the oscillation probabilities 
to fundamental neutrino parameters, which are the mass-squared differences and mixing 
angles and phases. It is therefore crucial to choose processes or observables that maximise 
the sensitivity to the parameter(s) of interest. 

It turns out that the density profile of matter that the neutrinos pass through before 
detection naturally accentuates the sensitivity to the mixing angles 6*13, #23 an d the mass 
squared difference 5 32 - These matter effects have been studied before, with atmospheric 
neutrinos, in various contexts, in Refs. |E 0, EE 11, EE EE 13 EE EE|. In particular, 
substantial matter dependences occur in the energy range of interest only if sin 2 #13 is different 
from zero; a non-zero value of this parameter also opens the window to CP violation in the 
lepton sector. Since only an upper bound exists on this parameter so far, the variation in 
sensitivity to other parameters can be large or small, depending on the true value of #13. 

This paper is devoted to the detailed study of oscillation probabilities of energetic (GeV 
energy) neutrinos and anti-neutrinos propagating through the Earth in a three flavour frame- 
work using accurate numerical methods. The paper is divided into two parts: The first part 
is devoted to the broad theme of sensitivity of the neutrino (and anti-neutrino) oscillation 
probabilities to the fundamental neutrino parameters in the GeV region. The results of this 
analysis are equally applicable to atmospheric neutrinos as well as to neutrino beams from 
future neutrino factories. While some of this information is already known, we emphasise a 
few surprising variations. 

Having determined the various sensitivities, we then use the results of the first part 
to maximise matter effects in a study of atmospheric neutrinos (and anti-neutrinos) using 
detectors having charge identification capability and study how best these parameters can 
be constrained/determined by such an analysis. 

The paper is organised as follows. In section 2, we outline the framework for the cal- 
culation of neutrino probabilities. Though numerical procedures have been developed to 
calculate any desired survival or conversion probability, in this paper we focus on the proba- 
bilities relevant for the accurate calculation of muon-neutrino (and anti-neutrino) events at 
a detector. We also list here the current limits on the oscillation parameters. 

In section 3, we consider, in turn, the variation of the muon neutrino survival and con- 
version probabilities as the oscillation parameters are varied within the allowed limits. The 
compendium of results listed here applies generically to any combination of neutrino source 
and detector where GeV energy neutrinos traverse the Earth. 

In section 4, we present results for event rates calculated with atmospheric neutrinos. 
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We also identify in passing interesting regions in energy-nadir angle space for long-baseline 
neutrinos. The results are calculated for up/down ratios of event rates binned as a function 
of the zenith angle or equivalently distance L to bring out the maximal sensitivity to param- 
eters, especially #13, 6*23 and the sign of #32. The question of hierarchy from the sign of £32 has 
been discussed in detail before [16] ; we focus here on the sensitivity of event rates and event 
ratios to the magnitude of this parameter. An important open question is the deviation from 
maximal of the mixing angle #23, that is, its octant sensitivity. This was analysed recently by 
Choubey and Roy [15]; we present results here which are complementary to their analysis. 
The issue of both the mass hierarchy and the octant of #23 have relevance to the structure 
of neutrino mass models. 

In section 5 we present a summary of our results and conclusions; we also highlight 
the improvement over the earlier results. Some remarks on the numerical computation are 
presented in the appendix. We also discuss the possible points of departure from earlier cal- 
culations, especially those that have been used in neutrino event generators such as nuance 




II. OSCILLATION PROBABILITIES 

For completeness we review the basic framework used in evolving the neutrino states 
and the calculation of oscillation probabilities. In a three neutrino framework, the neutrino 
flavour states |i/ a ), a = e, fx, r, are defined as linear superpositions of the neutrino mass 
eigenstates |z/j), i = 1,2,3, with masses m ; : 

Wa) = ^2U ai \v>i) . (1) 

i 

The \v a ) are the states produced in association with the charged leptons. The 3x3 unitary 
matrix U may be parametrised [?} (ignoring Majorana phases, which may be included by 
multiplying U by a diagonal phase matrix involving two more phases in addition to 5) as: 



U 



/ —iS 

I c 12Cl3 S12C13 Si3e 

-C23S12 - S 2 3Sl 3 Cl2e lS C23C12 - S23S 13 S 12 e l5 S23C13 I , (2) 

V s 23 s 12 — C23Si3Ci2e* — S23 c 12 — C23Si3Si2e* C23C13 



where cy = cos 6^-, Sy = sin^ and S denotes the CP violating (Dirac) phase. The 3x3 
neutrino mass matrix M 2 in the charged-lepton mass basis is diagonalised by U : 

U^M 2 U = diag(m^, m\, m 2 3 ). (3) 

The fundamental neutrino parameters therefore are the mixing angles 0^, phase 5, and the 
mass-squared differences Sy = mf — m 2 -. 

The time evolution of the mass eigenstates is governed by the Schroedinger equation, 

|i/ 4 (t)>=e-^*|i/ < (0)>. (4) 
Consequently the time evolution of the flavour states is given by the equation, 
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where [u a ] is the vector of flavour eigenstates, [^ Q ] T = [\v e ), |^), \ v T )\- 
The evolution equation in the presence of matter is given by 

d r , 
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(6) 



where the matter term A (ignoring the diagonal neutral current contribution) is given by 
A = 2y/2G F n e E = 7.63 x 1(T 5 eV 2 p(gm/cc) E(GeV) eV 2 . (7) 

Here Gp and n e are the Fermi constant and electron number density in matter and p is the 
matter density. The evolution equation for anti-neutrinos has the sign of A and the phase 5 
reversed. 

In general, the 3-flavour probabilities, in particular, P MAt and P efl of interest here, depend 
on all the oscillation parameters: #12, 023, #13, 8 2 \, S 32 , and the CP phase 5. We will focus 
everywhere on effects due to propagation in (Earth's) matter. It is useful to compute these 
probabilities in the constant density approximation for comparison with the exact numerical 
results below. We have ili 
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where terms involving <5 2 i have been ignored and the superscript m refers to mixing 
angles and mass square differences in matter. The relevant L/Z?-dependent terms in matter 
are given by, 
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(9) 



Note that for sufficiently large values of A/S 32 , all the three scales are of the same order of 
magnitude including A^ which cannot therefore be neglected. 
While 0i3 is small, its value in matter can be enhanced: 



sin 20 



sin 20 
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13 ^/(cos20 13 -A/5 32 f + (sin 20 i3 ) 2 
In particular, sin 20^ = 1 at resonance, when 

5 32 cos 20i3 = A ■ 



(10) 
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Parameter 


Best-fit value 


$21 

Am 2 


7.92 (1 ± 0.09) x 10" 5 eV 2 
2.40 (llole) x eV 2 


sin 2 0i 2 ; [9 12 ] 
sin 2 0i 3 ; [0i 3 ] 

Sill 2 6*23 5 [023] 


o.3i4 (i±8:il) 

< 0.032 
0.44 (ll°;i) 


; [34.i°] 
; [io.3°] 

; [41.6°] 



TABLE I: Table showing currently accepted [ly] best-fit values of oscillation parameters with 2a 
errors. In the case of the mixing angle #13, a 2a upper bound is shown. 



It is convenient to introduce the scale Am 2 |l9| instead of £32: 

Am 2 = <5 32 + 5 2 x/2 = m 2 - i(m 2 + m 2 ,), 

so that a normal or inverted hierarchy is simply indicated by a sign (and not magnitude) 
change in this parameter. 

Data on neutrino oscillations are available from the following experiments: 

• A combination of solar neutrino experiments and the KamLAND reactor 0, 0| exper- 
iment sets limits on the parameters #21 and #12; it also establishes the mass ordering 
1712 > rrii- 

• A combination of atmospheric neutrino experiments and the K2K experiment 0, 0| 
constrains the parameters in the (23) sector: £32 (or Am 2 ) and #23 . Note that the sign 
of this mass-squared difference as well as the deviation of #23 from maximality are not 
yet determined. 

• The reactor neutrino experiment, CHOOz|3], sets an upper bound on the effective (13) 
mixing angle using the above parametrisation. 

• The CP phase 5 is unknown. 

A combined analysis of these data 0] places limits on the oscillation parameters as 
summarised in Table 



III. SENSITIVITY OF OSCILLATION PROBABILITIES TO PARAMETERS 

We now discuss in detail the u^, survival and conversion probabilities as these are of 
interest here. Note that, in the absence of oscillations, the number of events in the neutrino 
sector is always a factor of two or more larger than in the case of anti-neutrinos due to the 
larger neutrino cross-section. We will comment further on its implication in section 4. 

The extraction of neutrino parameters to high precision requires the determination of 
neutrino oscillation probabilities in matter to a high degree of accuracy. Analytically, the 
effect of non-uniform matter poses a problem, while, in principle, the oscillation probabilities 
may be computed numerically to the requisite precision. Many, sometimes complicated, 



5 



analytical formulae exist for neutrino 
constant or variable density 



iii2 



agation in vacuum and in matter with either 



We use a Runge-Kutta solver to calculate the oscillation probabilities for various energies 
and nadir angles. Some technical details are given in Appendix A. All results presented in 
this and the following sections have been obtained using the density profile of the Earth as 
given by the Preliminary Reference Earth Model (prem) |27j and numerically evolving the 
flavour eigenstates through Earth's matter. In particular, the approximate expressions for 
the probabilities as shown in Eq. |U] are not used. 

The matter profile in the prem model is shown in Fig. Qas a function of the radius 
r from the centre of the Earth. The density jumps at inner-outer core and core-mantle 
transitions are clearly seen. An up-going neutrino with nadir angle 9 (shown in the upper 
x-axis) traverses all density zones of radii larger than the corresponding r shown in the lower 
x-axis. For 6 = 33°, neutrinos graze the core-mantle boundary, while for smaller 8, they 
traverse the core. 



45 60 90 




10 3 2xl0 3 3xl0 3 4xl0 3 5xl0 3 6xl0 3 
r (km) 



FIG. 1: Variation of the Earth's density profile (assumed spherically symmetrical) with distance 
from the centre (in km) in the PREM model 22 1 ■ The equivalent largest nadir angle of neutrinos 
that just graze a shell of given radius r is also shown. 



We also implicitly assume an iron calorimeter detector with charge identification capa- 
bility as in the minosQ and the proposed monolith [28] and ical/ino Q detectors. 
We therefore focus on neutrino energies in the GeV range which is of relevance to these 
detectors. We will see that the most interesting and sensitive region, purely in terms of the 
probabilities, is between 2-10 GeV. We look at the sensitivity of the oscillation probabilities 
to the fundamental neutrino parameters, namely the mass squared differences 821, Am 2 , the 
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mixing angles 9m ^13, #23 and the CP phase 5. 

In order to assess the parameter sensitivity, we consider 2a variations from the current 
best fit value of each parameter while the others are kept at their best fit values. We shall 
see that the probabilities are sensitive mainly to the (23) and (13) mixing angles and the 
larger mass-squared difference Am 2 . When matter effects are turned on the probabilities are 
also sensitive to the sign of this mass-squared difference. There is also a dependence on the 
density profile of the Earth. We shall discuss these dependences one by one. Since matter 
effects are proportional to sin# 13 , which is small, we are looking for sub-leading effects. The 
main role of matter is to enhance sin 9 13 due to resonance effects. Hence, when we emphasise 
a large effect, it is understood to be "large" with respect to this small parameter; matter 
effects, unfortunately, remain rather small with respect to the total events/processes we 
consider and hence need large exposures for their study. 

We shall consider neutrino energies in the range 2-10 GeV, which are relevant for atmo- 
spheric neutrino studies. Typically, we shall hold other parameters at their known central 
values when we discuss the variation with any one parameter. In particular, there is only 
a marginal/negligible dependence of these probabilities on # 12 and Srn^i and we shall not 
discuss them further. 

In general the normal hierarchy is assumed; this means that all matter effects are enhanced 
due to resonance in the neutrino sector, with smaller effects (and no resonances) in the 
anti-neutrino sector. Since we are only discussing probabilities, there is an approximate 
symmetry between parti cle p robabilities with normal hierarchy and anti-particle probabilities 
with inverted hierarchy [16j ]. This symmetry is exact in the limit that terms containing £21 
can be ignored. Thus we choose Am 2 to be positive (normal hierarchy) while discussing 
probabilities. Results with the inverted hierarchy are discussed in the next section. 



A. Variation of probabilities with 8 



13 



In general, matter effects are significant provided #13 is not small. The dependence of 



matter effects on this parameter has been exhaustively studied elsewhere 



e dependence 01 

HI HQ 13 

13j, [lj, |l5j, |l6[ and will not be discussed in any detail in this paper. We merely show a sample 
dependence on this parameter in Figs. 121 and El where P m and P eM are plotted as a function 
of the nadir angle 9 for three energies, E = 2,5, 10 GeV. The variation in the probabilities 
as #13 varies over its 2a allowed region, 13 < 10.3°, is significant at small nadir angles for 
low energies (E < 3 GeV), at virtually all nadir angles at larger energies (around E ~ 5 
GeV), and tapers off at larger energies (by about E ~ 10 GeV) when matter effects become 
irrelevant. Notice the effect of core crossing at nadir angle 9 = 33° which is especially visible 
when E = 5 GeV when 9\ 3 7^ 0. . 

For completeness we show the relatively weaker sensitivity to this parameter of the anti- 
neutrino probability P w in Fig. HJ When the hierarchy is inverted the behaviour of P and 
P are interchanged. 



B. Variation of probabilities with Am 2 

We begin with P M/J , which is extremely sensitive to this parameter, as can be seen in 
Fig. El The figure shows the variation of P MA , with the nadir angle 9 at different neutrino 
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FIG. 2: Variation of P„„ with #13 as a function of nadir angle 9. Probabilities for #13 = 0, 5, 10° are 
shown as dotted, solid and dashed lines respectively. Sensitivity to #13 at three different neutrino 
energies, E = 2,5, 10 GeV, is shown in the three panels. Other parameters are set to their best-fit 
central values (see Table QJ). Normal hierarchy is assumed. 




FIG. 3: Variation of P ejl with #13. See caption of Fig.|2 Although P eil is non-zero when #13 = 0, the 
non-zero contribution comes from an oscillatory term dependent on £21 and is very small/invisible 
beyond E ~ 1 GeV. 



energies, for a la variation of Am 2 : Am 2 = (1.8, 2.4, 2.9) x 10~ 3 eV 2 . The top three panels 
are for #13 = 9° and the lower three for # 13 = at three different energies. Notice that the 
smooth oscillations seen in the lower panels are modified due to matter effects (turned on 
when 613 ytz 0) in the upper panel. 

In general, the modification is significant in the small nadir angle bins for lower energies 
(E = 2 GeV), and at all nadir angle bins in the intermediate energy region (represented 
by the central panel at E — 5 GeV) when resonance occurs in the mantle. The interplay 
between the variation in Am 2 (even at the 2a level) and that in the relatively unknown #13 
is clear from the E = 5 GeV panels: the same muon survival probability for upward-going 
neutrinos (8 = 0°) can come from (Am 2 , #13) both large: (2.9 x 10~ 3 eV 2 , 9°) or both small: 
(1.8 x lCT 3 eV 2 , ~ 0°). 
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FIG. 4: Variation of F w with 13 . 



See caption of Fig. |2j 



Since matter effects are relatively unimportant for anti-neutrinos (in the normal hierarchy) 
the anti-neutrino survival probability at all allowed # 13 is close to the neutrino survival 
probability at 9 13 = 0. This can be seen from Fig. |H1 where P MM is shown. In fact, the 
difference between the neutrino and anti-neutrino survival probabilities is a measure of the 
matter effect and hence that of #13 and the sign of Am 2 (the mass hierarchy) as has been 
discussed earlier (lif . 

The conversion probability P efl is small unless #13 is substantial. We show the high 
sensitivity of this probability to variations in Am 2 for 9 13 = 9° in Fig. An interesting 
feature is the substantially larger probability for small nadir angles (0-30°) and low energy 
(E = 2 GeV) for the Am 2 = 1.8 x 10~ 3 eV 2 value due to resonance inside the core. This 
feature is visible only at low Am 2 values: for example, for E = 2 GeV, it occurs roughly 
for £ 32 ~ Am 2 < 2.0 x 10~ 3 eV 2 , with a small uncertainty in the limit due to the unknown 
#13. For larger values of Am 2 , larger densities than are available inside the Earth are needed 
to satisfy the resonance condition, Eq. at E = 2 GeV; hence there is no substantial 
enhancement of these probabilities in the small nadir-angle region. 

A substantial (> 20%) P eiI in this region at small energies around E = 2 GeV is thus a 
clear indication that Am 2 < 2 x 10~ 3 eV 2 . While this fact may not have an impact on the 
overall event rates for atmospheric neutrinos, it will be important for long baseline neutrinos 
since one can separately study P efl through wrong sign muons. The anti-neutrino conversion 
probability, however, remains small even for large 9 13 and is therefore not shown. 



C. Variation of probabilities with 823 

The Super-Kamiokande data favour a best-fit value of #23 — 45° in a 2-flavour analysis. 
Although a recent 3-flavour global analysis 0] indicates that this parameter may be slightly 
smaller, #23 — 41.6°, the 2a allowed parameter space spans both octants: 36° < #23 < 52°. 
The dominant (matter-independent) term in the survival probability depends on sin 2 2#23- It 
is therefore difficult to substantially decrease errors on #23 via a measurement of the leading 
contribution. Furthermore, even if a deviation from the maximal value is measured, it is 
impossible to determine the octant with such a term. 
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FIG. 5: Variation of Pun with Am 2 at #13 = 9° (upper panels) and #13 = (lower panels). Am 2 
values used are the 2a allowed variation (dotted line for 1.8 x 10 -3 and dashed line for 2.9 x 10~ 3 
eV 2 ) of this parameter around the solid curve for the best-fit value (= 2.4 x 10~ 3 eV 2 ). The values 
of Am 2 in units of 10 -3 eV 2 are marked in the top right panel of the figure. 
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FIG. 6: Variation of P„„ with Am 2 at #13 = 9°. See caption of Fig. [3] for details. The probability 
is not significantly different at other values of #13 and is similar to the neutrino survival probability 
in Fig. for 13 = 0. 
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FIG. 7: Variations of P e ^ with Am 2 at #13 = 9°. See the caption to Fig. El for details. 

Methods to determine the octant of 823 have been discussed in detail elsewhere |l5| . 
Sensitivity to the octant of this angle is realised through sub-leading terms that depend 
on 823, not 2#23, as can be seen from Eq. El These are matter-dependent and sub- leading 
because they are also proportional to sin# 13 , which is known to be small but is otherwise 
unknown. 

Fig. |H1 shows the sensitivity of P^ to variations in 6*23. For clarity of discussion, we choose 
a central value of 45° (that is, choose a maximal value rather than the slightly smaller central 
best-fit value as used earlier) and the same 2a variation about it. When #13 = 0, symmetric 
2a variations about the central value of 45° lead to the same survival probability, as can be 
seen at all neutrino energies in the lower panels of the figure. 

When 8 ' 13 is not zero, the survival probability for 823 less than maximal (red dotted line) 
lies consistently above the central value (solid line) for all values of Am 2 , E and nadir angles. 
This happens because the terms in P^ involving sin #23 and sin 28 2 3 come with the same 
relative (negative) sign, as seen from Eq. As #23 increases from the first octant towards 
maximal, both these terms are increasing so that the probability systematically decreases. 
However, as #23 increases from the maximal to a value in the second octant, sin $23 increases 
while sin 2^23 decreases, leading to a complicated dependence of the probability on this 
parameter. Hence no such regular behaviour is seen when #23 is larger than 45° although, 
in a large portion of phase space at E = 5-10 GeV, the probability for #23 < (>) 45° is 
systematically larger (smaller) than that at #23 — 45°. 

It is clear from Fig. |H1 that, for non-zero #13, the probability curve for #23 i n the first octant 
(37°) is better separated from that for 6*23 = 45°, than the curve for #23 in the second octant 
(53°). Evidently, the ability to determine whether #23 is different from maximal will depend 
on which octant the true value of #23 lies in. This is also reflected in our numerical results 
with atmospheric neutrino events, as discussed in the next section. 

Precisely the opposite effect is seen in the conversion probability P e/1 as seen in Fig. El 
Here, the probability increases with #23 for all Am 2 values at all energies and nadir angles so 
that the probability for #23 < (>) 45° is systematically larger (smaller) than the probability 
with 823 = 45°. This can be easily seen from the fact that there is a single term proportional 
to sin 6^3 in Eq. El for P efl , appearing with the opposite sign to the matter terms in P w . 
Hence a long base-line experiment, where u e and beams are separately available, will be 
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FIG. 8: Variation of Pan with #23 for #13 = 0, 9°, as a function of the nadir angle. While probability 
curves for #23 values symmetrically larger and smaller than 45° coincide when #13 = (bottom 
panels), they differ for non-zero #13 as shown in the top panels. 



able to clearly establish the octant of #23 by studying the P eu conversion probability via the 
wrong-sign muon events. 

Note that if #13 = exactly, then the octant determination cannot be made from P afl 
although P efl still shows the same dependence on 6*23 as discussed above. However, P eM is 
insignificant in this energy range and hence octant discrimination at #13 = is possible only 
through a study of P efl at low energies around 0.1 GeV, when resonance effects in the (12) 
sector enhance this probability. This is outside the scope of the present paper and will be 
discussed in a separate publication. 

This relatively systematic dependence on #23 is in contrast to the rather complex depen- 
dence of the survival and conversion probabilities on Am 2 and 8 13 . Both these probabilities 
contribute to the observed muon events in studies of atmospheric neutrinos. We shall explore 
this further in a later section to maximise this "octant- seeking" effect. 

In contrast, the matter dependence is small for the anti- neutrinos; hence, the anti- neutrino 
survival probabilities for all #13 values are similar to the neutrino survival probability at 
#13 = and do not distinguish the octant of #23- We reiterate that this is a consequence 
of the chosen hierarchy; opposite results are obtained with the inverted hierarchy (matter 
effects are ultimately larger in the normal hierarchy since the anti-neutrino cross-sections 
are smaller than the neutrino cross-sections so that event rates are larger and matter effects 
better differentiated in the neutrino sector). 
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FIG. 9: Variation of P efl with 6> 23 for 13 = 9°. 
D. Variation of the probabilities with Earth density 

In order to compute the effect of Earth's matter on the probabilities, we have used the 
prem model which gives the density profile of a "spherical equivalent Earth". While 
the locations of the discontinuities and mantle-core transitions are rather well-known, the 
absolute values of the densities themselves are not so well established. Hence, in order to 
study effects of uncertainties in the Earth's density, we have retained the locations of the 
discontinuities while changing the density values. We have done this in a simple manner by 
changing all the densities within the core by Ap corc = 0.6 gm/cc (a change of roughly 5%, 
as allowed by the model), and suitably adjusting the mantle densities in such a way as to 
maintain the overall mass of the Earth to be constant. Such a procedure results in a much 
smaller change in the mantle densities of Ap mant i e ~ — 0.2Ap core , in the opposite direction. 

The consequences of such a density change to the neutrino survival and conversion prob- 
abilities are shown in Figs. El and ^2 respectively. Here p> and p< correspond to increasing 
and decreasing the core densities by 5%, with the mantle densities adjusted suitably. The 
solid black line is for the original prem density profile. Again, the size of matter effects 
depends on Am 2 ; changing the density alters the Am 2 at which resonance occurs, for a 
given neutrino energy. 

A point to note is the difference between the prem profile and constant density slabs. 
The former has a continuously changing density profile, even within slabs. Hence neutrinos 
with a band of energy can undergo resonance in any given slab. In contrast, only a neutrino 
with a single definite energy can undergo resonance in a constant density slab (apart from 
having purely adiabatic propagation inside any slab). Due to this, the probability curve as 
a function of zenith angle for a given energy can look very different when computed with 
the prem profile and with a constant density approximation, even when the latter closely 
follows the prem profile. However, when an integration over an energy bin is performed, 
such variations get averaged out. More details on this issue are given in the Appendix. 

At low energies where the matter effects are significant only for core-crossing neutrinos 
at small nadir angles, the effects of altering the density profile are also seen only at these 
small nadir angles, as can be seen from the upper panels of the figures. At higher energies, 
changes appear at larger nadir angles as well, as can be seen from the lower panels, since 
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FIG. 10: Variation of P«„ with changes in the Earth's density for #13 = 9° and a 2a variation in 
Am 2 at E = 2, 5 GeV. The curves labelled p > and /3< correspond to increasing and decreasing the 
core densities by roughly 5% (with a compensating change in the mantle densities) compared to 
the black solid line for the prem density profile. 



resonance (and enhanced matter effects) occurs in the mantle itself. While the variations are 
small, except at small nadir angles, again, they are complex and depend on both energy and 
a precise knowledge of Am 2 . Probing the Earth density, especially in the core, with neutrino 
oscillation physics using neutrino factory beams has been discussed earlier [31]. Here, only 
the dependence on 9 13 was considered while Am 2 was kept fixed. 

We remark that in all cases there is also a dependence on 13 at small nadir angles since 
the variations with 6* 13 are substantial here, as can be seen from Fig. El The dependence on 
density variations may be disentangled from that on # 13 since substantial variations in the 
intermediate nadir angle region can only be due to 9 13 , as seen from Fig. 

The anti-neutrino probabilities again do not show any significant dependence on these 
parameters in the normal hierarchy. 



E. Variation of probability with the CP phase 

We now explore the dependence of the probabilities on the CP phase 5. This dependence 
is shown in Fig. again for 9 13 = 9°. Apart from the dashed vertical line at 9 = 90° that 
separates the "up-going" probability from the "down-going" one, the dotted vertical line at 
9 ~ 55° indicates the nadir angle corresponding to the so-called "magic base-line" where 
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FIG. 11: As in Fig. UU] for P t 



the probabilities are independent of the CP phase. Since the Earth mantle density is not a 
constant, this is actually a band around that nadir angle, as can be seen from the figure. 

The effect of the CP phase 5 competes with the matter effect which in turn depends on 
the relative size of the matter term A compared to Am 2 . The variation of the probabilities 
(as a function of energy and nadir angle) with 5 for the current 2a allowed range of Am 2 is 
shown in Fig. El This variation is so small that it is unlikely to be measured via a study of 
atmospheric neutrinos and may need long base-line measurements where the spectrum and 
nadir angle are well-known. Nevertheless, we make a few remarks on the general behaviour. 

While the survival probability is symmetric for 5 = ±7r, ±7r/2, P efl can distinguish 
the cases 5 = ±7r/2. At low energy, E = 2 GeV, the top panels in Fig. ^] indicate that the 
survival probability P w is typically larger for S = at all nadir angles, smaller for 5 = ±7r/2 
and smallest for 5 = ±7r, independent of Am 2 . This is not true at larger energies, as can 
be seen from the lower panels of the figure. Hence, if these small variations can indeed be 
measured, information on 8 may be obtained with some confidence, only if Am 2 is known 
to much better than the current precision. 

The situation is murkier with the conversion probability P efl , as can be seen from Fig. 1131 

5 GeV 
-7I-/2 



The clear trend that was visible with P„„ at low energy is no longer present. At E 



there is a systematic trend between the curves for 8 = and n/2 and between 8 - 
and ±7r; they behave in the same way relative to each other. The complex effect of 5 is 
overlaid on an already small P efl . Signatures of P e[li are very clean however with long-base- 
line detectors (via wrong-sign muon measurements ); t his may facilitate a measurement of 5 
at such detectors, as has been discussed elsewhere 33] . 
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FIG. 12: Variation of P„„ as a function of nadir angle with the CP phase S for #13 = 9°, for a 
2a variation of Am 2 . The curves shown are for 5 = 0, ±7r/2, and ±7T. The vertical dotted line 
indicates the magic base-line where the probabilities are independent of 5. 

The anti-neutrino probabilities are rather insensitive to matter effects or the CP phase 
(in the normal hierarchy) and we do not discuss them here. 

IV. EVENT RATES IN A DETECTOR 
A. Preliminaries 



While one can identify clearly the regions of sensitivity to the fundamental neutrino 
parameters through an analysis of the oscillation probabilities, it is crucial to identify the 
appropriate observables which will enable a precision measurement of the parameters. The 
experimental observables are primarily the event rates in a detector. The fully differential 
event rate for neutrinos of flavour a to be detected is given by the general expression: 



dN a 
dEdx 



K y "£<S> p (E,x) Pp a {E,x) a a (E) 



(12) 



where x = L/E and a a is the total interaction cross-section for the a type neutrino to 
interact with the detector material. Here Pp a is the conversion probability of a neutrino of 
flavour /3 to a flavour a (which also includes the survival probability when a = (3). 
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FIG. 13: As in Fig. ^Jfor P e „. The curves shown are for 5 = 0, 7r/2, — 7r/2, and ±7r. 

The flux-dependent term Qp(E,x) is related to the doubly-differential neutrino (or anti- 
neutrino) flux of flavour j3, d 2 / g(i?, 0)/d In E d cos 6, which is a function of the energy E and 
nadir angle 9 through a Jacobean of transformation. In the case of atmospheric neutrinos a 
range of zenith angles are available while for long-baseline neutrinos this angle is kept fixed 
by the location of the source. 

The factor K y is the detector dependent factor measured in units of kton-years. While 
we assume the detector to be mainly made up of magnetised iron with active detector 
elements, this is not crucial since only the detector mass and exposure times are relevant. 
In the MONOLITH and ICAL/lNO proposals, where muons from charged-current ^-nucleus 
interactions are detected, the active detector elements are resistive plate chambers (RPCs, 
gas-filled glass chambers). In either of these proposals the detector mass is almost entirely 
(> 98%) due to its iron content. We will be interested here in event ratios; hence the factor 
K y and other actual detector details will only determine the errors. Furthermore, we assume 
that the detector is capable of correctly identifying the charge of the muons in the final state. 
This will be better than 98% for energies 2 < E < 10 GeV for the ical/ino detector. This is 
crucial for the precision determination of the neutrino parameters in any future experiment. 

B. Atmospheric Neutrinos 



We now focus on neutrino oscillation studies with atmospheric neutrinos. Both and v e 
(and their anti-particles) are produced, typically in the ratio 2:1. 
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The distance of propagation L of the neutrino from the point of production to the detector 
is given by, 



'(Ro + L ) 2 - (Rsm6) 2 + Rcos6 , (13) 

where L$ is the average height (taken to be 15 km) above the surface of the Earth at which 
the atmospheric neutrinos are produced, Ro is the radius of the Earth and R = Ro — d, d 
being the depth at which the detector is located underground (chosen to be 1 km). Note 
that 9 = corresponds to neutrinos reaching the detector vertically upwards. 
The event rate in a given bin of x = L/E is, 

K- (x) =i 6x1 *g ^ ■ (14) 
bml ' ibin J Emln E dln£dx ' 1 ' 

henceforth we discuss only the case of muon-neutrinos, a = \x (or ~p). Then both P e/1 and 
P wt contribute in the expression above. However, due to the smallness of the (13) mixing 
angle, #13, the contribution of P efi is generally small and is significant only near large L/E 
where it is about 10-20% (5%) for neutrinos (anti- neutrinos). 

The event rate is expressed as a function of x, averaged over a bin width that will be 
appropriately chosen to maximise the sensitivity to the sign of £32 or the octant of 6*23. The 
expression given in Eq. El is the best-case scenario since the integration is over the neutrino 
or anti-neutrino energy. We discuss the effect of including the detector resolution functions 
in the next section and proceed now to analyse the ideal case with a perfect detector. 



C. Event rates with an ideal detector 

A useful measure of oscillations is the ratio of up-coming to down-going neutrinos with 
nadir/zenith angles interchanged. This is clear from Fig. El The fluxes of atmospheric 
neutrinos from directions 9 and (tt—9) are expected to be similar in the absence of oscillations, 
especially for larger energies (E greater than a few GeV). Since the path- length traversed, 
L, is related to 9 as 

L = f{\cos9\) + Rcos9 , 

(see Eq. IT3*|) . the replacement 9 <-> (71 — 9) effectively changes the sign of the second term in 
the equation above, thus taking, for instance, a down-going neutrino to an up-coming one. 
The ratio of events in the up-down directions for a given x = L/E, therefore, reflects the 
asymmetry of the up-down fluxes, due to oscillations. We define [34], 

^ U . No. of events from up-coming muon neutrinos(s) 
D No. of events from down-going muon neutrinos(x) ' 

where x = x(9 <-> (71 — 9)) and the number of up-coming (U) or down-going (D) events is 
calculated using Eq. EJ Similarly the ratio U/D defines the corresponding up/down ratio 
for anti-neutrinos. Since the effect of oscillations on the denominator is small, the ratio 1Z 
is effectively the ratio of oscillated to unoscillated events with the same L/E. 

While reflecting the effect of oscillations, this ratio also minimises errors due to the un- 
certainties in the overall flux normalisation (which can be as large as 30%) and those in 
the cross-sections (about 10%). We now proceed to determine these ratios numerically, and 
study their sensitivity to the oscillation parameters of interest. 
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FIG. 14: A schematic showing the up- and down- neutrino directions and their labelling in the 
nadir angle 8. 



We use the 3D atmospheric neutrino fluxes as calculated by Honda et al. [25j . These 



have been obtained from the nuance neutrino generator |17[. The charged current muon- 
neutrino nucleus cross-sections used have also been extracted from the nuance code. At the 
low end of the energy spectrum, the interaction with the detector material is mainly through 
quasi-elastic and resonance interactions. When the energy is a few GeV, deep inelastic 
scattering (DIS) dominates, ultimately taking over by about 10 GeV, as this cross-section 
is proportional to the neutrino energy. There are still issues about the transition from the 
resonance (mainly single pion dominated) region to the DIS region however, such errors 
are minimised by always analysing ratios of events. Roughly speaking, in the energy range 
of interest from few to 10's of GeV, half the events are from quasi-elastic and resonance 
interactions and the other half from DIS. This proportion is somewhat sensitive to finite 
detector resolutions, since the neutrino energy is smeared over a much larger range than 
that observed; however, the events are still dominantly low-energy ones owing to the steep 
fall (faster than l/E 2 ) of the incident atmospheric neutrino flux with energy. 

We find, as studies of the probabilities suggest, that variations of the event rates due to 
uncertainties in 5 21 and # 12 are small. We therefore fix them to their best-fit values. We 
also set the CP phase S = and fix the Earth's density to be as given by the prem density 
profile The remaining parameters, viz., Am 2 (both magnitude and sign), # 13 and #23 (in 
particular, its deviation from maximality and hence also its octant), are the parameters to be 
determined or constrained in the analysis. A study of atmospheric neutrino events is sensitive 
to all these parameters (but the magnitude of Am 2 ) only through matter effects. That is, #13 
must be non-zero and substantial for there to be any sensitivity to these parameters. Since 
this parameter is known to be small, it therefore follows that large exposures are required to 
determine any of the above parameters to better precision than are currently known. 

In order to proceed further, we shall assume in the following that #13 is substantial; the 
precise threshold will be determined through the analysis. It is already known that the 
sign of Am 2 can be determined via the difference asymmetry of the up/down ratios in the 
neutrino and anti-neutrino channels: 

A=U/D-U/D , (15) 
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where U and D are the relevant differential event rates for up and down events as a function 
of L/E and U and D the corresponding rates for anti-neutrinos. This asymmetry can 
be maximised by choosing to integrate over L/E bins that include one half-period of the 
oscillation. This can be approximated by the matter-independent condition, 

l.267\6 32 \L vr 

= n— ; n odd. (lb) 

E 4 

A detailed analysis of this asymmetry has already been done in Ref. [T^J]; we only remark 
here that we require sin 2 2^13 > 0.06 (#13 > 7°) for the sign of Am 2 to be determined 
using this technique. Furthermore, this determination requires 750-1000 kton-year exposure, 
depending on the value of #13, thus setting the scale for our present analysis. 

We focus therefore on the precision to which the magnitude of Am 2 and the octant of #23 
can be determined, given such large exposures. (Current data from the Super-Kamiokande 
collaboration restrict these to the ranges 1.8 < |Am 2 | x 10 3 eV 2 < 2.9 and 36.5 < #23 < 
54.5°.) This again depends on sin 2 9 13 , which is expected to be shortly measured with good 
precision (to within a few percent) by the Double-CHOOZ experiment (36[. We study both 
cases: when 813 is known and hence kept fixed in the analysis, as well as the case when it is 
allowed to vary freely. We restrict ourselves to the normal hierarchy, with Am 2 positive, so 
that matter effects (and hence sensitivity to the octant of #23), are enhanced in the neutrino 
channel. We integrate event rates over an energy range of E = 5-10 GeV to maximise 
statistics while retaining sensitivity to matter effects. 

In Fig. El we show the variation of the up/down events ratio for different Am 2 values as 
a function of log 10 L/E for two values of 6*23 = 40°, 50°, in two octants. Here 6*13 is fixed to 
9°. Two features are immediately noticeable: (1) the position of the minima and maxima in 
L/E are not altered by changing #23; furthermore, the events ratio at the first minimum is 
not very sensitive to 823, and (2) the effect of changing 823 from a value in the first octant 
to a corresponding one in the second octant is to systematically decrease the event rates in 
all bins for all Am 2 values. 

Furthermore, although not shown in the figure due to constraints of clarity, the curve for 
maximal 823 = 45° lies between the two curves for 823 = 40, 50° in all L/E bins beyond the 
first minimum. Such a systematic decrease with increase in #23 was seen only in some zenith 
angle and energy ranges (for example for 8 = 0-70° for E = 5 GeV and for 8 = 0-50° for 
E — 10 GeV, when 813 = 9°; see the top panels of Fig. (SJ). By a judicious choice of the 
energy and L/E interval, this effect has been converted to a systematic difference for all bins 
to the right of the first minimum; moreover, it is in these bins that the sensitivity to 823 is 
significant, so that this dependence is robust and easy to observe. 

Note that the difference asymmetry defined in Eq. E3 is a difference between neutrino 
and anti-neutrino rates ratios. In this case, the systematic decrease with increasing 823 is 
true in all L/E bins for any Am 2 value, by definition. That is, the result for #23 = 45° 
always lies between that for a value of 823 in the first and second octant. This is shown in 
Fig. However, as can be seen from the relative size of the error bars, the task of actually 
extracting the octant of #23 from measurement of such an asymmetry is severely limited by 
statistics. In fact, it is the poor statistics in the anti-neutrino sector that limits the efficacy 
of this parameter. 

The effect of increasing # 13 away from zero is seen in Fig. El where the events ratio is 
plotted as a function of log 10 L/E for different Am 2 values. The two histograms for each 
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FIG. 15: Variation of the ratio of the rates for up-coming and down-going neutrinos, integrated 
from E = 5-10 GeV, in bins of log 10 L (km)/E (GeV) = 0.1. The variation with Am 2 is shown 
in the three panels, where results for a Am 2 over the currently allowed la range, via., Am 2 = 
(2.1,2.4,2.7) x 10" 3 eV 2 are shown. The two histograms in each panel correspond to 623 = 40° 
(upper) and 50° (lower). The value of #13 is kept fixed at 9°. Statistical error bars corresponding 
to an exposure of 1000 kton-years are also shown. 
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FIG. 16: As in Fig. I15| but for the difference asymmetry, A = U/D — U/D. Three histograms are 
shown, for 623 = 40° (dotted), 45° (solid) and 50° (dashed lines), as a function of log 10 L/E in bins 
defined in Eq. 1161 It is seen that the histograms for 623 < 45° and 623 > 45° are systematically 
greater and less than that for 823 = 45°. 



Am 2 value correspond to #13 = 0, 9°, where the latter value is simply chosen as being within 
the range allowed by current data and where matter effects are known to be substantial. The 
effect of increasing 813 is to turn on matter effects that move the muon survival probability 
maxima (as a function of log 10 L/E) away from 1 and the minima away from zero. This 
means that for non-zero #13 the events ratio is smaller at probability maxima and larger 
at probability minima than for 613 = 0. (Note that the extent of deviation is somewhat 
suppressed by the sub-dominant contribution of P efl to the dominant terms; experiments 
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such as those with neutrino factories where such contamination does not exist will be even 
more sensitive to matter effects). 
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FIG. 17: As in Fig.ll5( but for fixed #23 = 40°, while #13 = 0, 9° in each panel. The outer histogram 
(larger at maximum and smaller at minimum) corresponds to #13 = 0. 

The contrasting behaviour of the events up/down ratio with #13 and #23 for a given Am 2 
is clear: an increase in the latter systematically decreases the ratio, while an increase in the 
former decreases the ratio at the log 10 L/E maxima and increases them at the log 10 L/E 
minima. Such behaviour enables the extraction of the different parameters when the data is 
fitted to the theory. 

To demonstrate this (and to determine the efficacy and precision with which the parame- 
ters can be determined), we begin by computing up/down neutrino events ratios for the set of 
input parameters, (9 13 , 9 23 , Am 2 ) = (7°, 40°, 2.4 x 10" 3 eV 2 ), in different log 10 L/£(km/GeV) 
bins from 1.6 to 3.4 of width 0.1 each. We then fit this "data" to these three parameters, 
and extract the allowed parameter space to establish how well these parameters can be de- 
termined. In particular, we focus on the precision of measurement of all parameters as well 
as the possible determination of the octant of #23 . Since we are considering ratios, we in- 
clude only statistical errors in our analysis. Note that a zenith angle cut on very horizontal 
events that may not be easily detected by horizontally aligned detectors such as ical/ino 
only removes the small L/E bins. For instance, a cut of cos# = 0.1 leads to a cut on 
log 10 L/E > 2.15. For such small values, as can be seen from Fig. there is negligible 
dependence of the up/down ratio on the neutrino oscillation parameters. Hence, such cuts 
will not affect our analysis. 

Fig-EHshows the allowed region at 95% CL and 99% CL in the (6*13, #23) parameter space, 
using standard \ 2 minimisation, for a fixed value of Am 2 = 2.4 x 10~ 3 eV 2 . At 95% CL, the 
up/down ratio barely disallows maximal mixing in #23; it also disallows the "wrong" octant 
solution of #23 = (7r/2 — O?^) = 50°. However, both these sensitivities go away at the 
99% CL level when an island of allowed parameter space opens up around the wrong-octant 
solution, in a region to the right of it. 

At this point we note that #13 is likely to be rather precisely fixed (to much better than a 
percent) by the Double-CHOOZ experiment [36j]. We therefore observe the effect of keeping 
#13 fixed and varying the other two parameters. This is shown in Fig. EH where the allowed 
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FIG. 18: Allowed parameter space in (^23^13) variables. Input used was (40°, 7°), for Am 2 = 
2.4 x 10~ 3 eV 2 (shown as the solid point, also the best-fit). Shown are the 95% and 99% CL 
contours; it is seen that the "wrong-octant" solution to the right of 623 = 50° is allowed at 99% 



parameter space in (823, Am 2 ) space is shown for the same input parameters as before. Again, 
both the maximal solution and the wrong octant solution for 623 are disallowed at 95% CL 
level. While maximality is still disallowed, a small island opens up around the wrong-octant 
solution at the 99% CL, again to the right of it. Also, Am 2 is constrained to a precision of 
better than 6% at 3a. 

The results are a complicated function of both #13 and Am 2 . In general, the wrong-octant 
and maximal solution is disallowed at 95% CL up to an input value of 623 = 42° or 48°, i.e., 
a deviation of 3° away from maximal in either direction (or 10% deviation in sin 2 623) but is 
allowed at 99% CL. This result is mildly dependent on the value of 813 with results obviously 
improving for larger # 13 . For instance, the 99% CL contours for the same input data set 
are plotted in Fig. |2H1 for 8 13 = 7°, 9°. The precision in Am 2 is marginally worse for the 
larger (9 13 ; however, although at both values of #13 maximality is disallowed at 99% CL, the 
wrong-octant solution is completely disallowed only for the larger (13) mixing angle. 

It is possible to reduce the allowed parameter space by adding the contribution of the 
anti-neutrinos as well. That is, we now consider the input "data set" to consist of both 
the neutrino and anti- neutrino events ratios. Since we always consider up/down ratios to 
minimise errors due to overall normalisation of fluxes and cross-sections, this still means that 
we need to separate the charged muons with good efficiency (that is, identify the process 
as originating from a neutrino or anti-neutrino). In principle, charge misidentification can 
lead to systematic errors since, for example, a neutrino event wrongly identified not only is 
lost from its parent sample, but also adds to the anti-neutrino events. However, in proposed 
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FIG. 19: Allowed parameter space in (#23, Am 2 ) variables. Input used was neutrino up/down event 
rates at (40°, 2.4 x 10" 3 eV 2 ), for 6 13 = 7°. Shown are the 95% and 99% CL contours. 
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FIG. 20: As in Fig.fTQl but for different 6 13 values. Shown are the 99% CL contours for 9 13 = 7°, 9° 
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experiments such as ical/ino, charge identification efficiency in this energy range is better 
than 98% so we ignore such correlation errors. 

We show the allowed parameter space on including both the neutrino and anti-neutrino 
data sample in Fig. |^ Here the complex dependence on the input value of Am 2 is also 
shown: as Am 2 is increased between its current la allowed values of Am 2 ~ (2.1-2.7) x 10~ 3 
eV 2 , the allowed parameter space in (#23, Am 2 ) around the wrong-octant solution shrinks, 
and disappears at the upper value of Am 2 . Hence, it appears that deviations from maximality 
as well as determination of the octant can be typically easily established at the 95% CL level, 
provided #13 is well-known (and at least of the order 13 = 7°). Results at the 99% CL level 
are harder to quantify and reflect the complex nature of this many-parameter problem. 
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FIG. 21: As in Fig. 1191 for the sum of neutrino and anti-neutrino up/down event rates, for 
(023,01s) = (40°, 7°) but for a la variation in Am 2 of Am 2 = (2.1,2.4,2.7) x 1(T 3 eV 2 . While the 
wrong-octant solution, that is, the region around 623 = 50° is disallowed at 95% CL in all cases 
(not shown in the figure), it is allowed at the 99% CL level as shown. Deviation from maximality 
can always be established at 99% CL. 

We now ask how sensitive these results are to the finite resolution (in determining neutrino 
energy and direction, and hence its L/E) of the detector. 



D. Event rates with finite detector resolution 

Inclusion of finite detector resolution reduces the sensitivity, especially beyond the first 
oscillation minimum and maximum in L/E. The smearing in direction affects the resolution 
in path-length. A straightforward way to include such effects is to smear the observed energy 
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and direction of the neutrino with Gaussian resolution functions: 

1 



Ri{E',E) = exp 
V 2n cr E 

R 2 (L',L) = —j= — exp 



< B ^' )2 ' (17) 



2txo l 



24 

-{L - L 
24 



A2 



Hence, the event rate now includes the probability that a neutrino of a given V and E' is 
detected in the detector with path-length L and energy E. We have 

^ = L Ax L dE I ^ {E '' E) I dL ' ML '' • (18 > 

where J is the Jacobean of transformation. 

We re-evaluate the event rates and the up/down ratios using this equation, with o E = 
0.15E' and a E = 0.15L'. These are realistic widths obtained by a geant analysis of atmo- 
spheric neutrino events by both the monolith and the ical/ino collaborations. Such a 
smearing has the effect of accounting for errors in correctly identifying the L/E bin for a 
given event, and so accounting for bin-to-bin correlations. 

We comment in passing on the use of finite widths in L rather than in 9. The smearing in L 
actually arises because of the uncertainties involved in reconstructing the neutrino direction. 
Hence, the smearing should be in 9 not L. Choosing a resolution in 9 rather than in L (or 
equivalently cos 9) may give more realistic spreads, especially at large angles where smearing 
in cos 9 may underestimate the large variations in L for small changes in 9. This can be seen 
in Fig. 1221 Applying a constant AL/L of 15% corresponds to large angular spreads at small 
angles where base-lengths are large, while a constant angular width A9 of 5° leads to larger 
spreads in baselines at large angles. In this paper, we go with convention 2^, 3(| and define 
widths in the base-length L. 

In Fig. 1221 we show the variation of the up/down events ratio for different Am 2 values as a 
function of log 10 L/E for #23 = 40°, 50° when the resolution function is included. The upper 
panels correspond to smearing in E and 9 while the lower panels correspond to smearing in 
E and L. Here #13 is fixed to 9°. A comparison with the similar Fig. where no resolution 
functions have been included, shows immediately that the effect of changing the octant of 
#23 remains roughly the same as before (about la maximum deviation in each bin) while 
the oscillation pattern itself gets smeared away due to finite resolution functions so that the 
minima and maxima of the oscillations are not as clearly visible, especially beyond the first 
minimum. It is seen that the peaks and troughs are better defined when smearing in L 
rather than 9 is used. However, the differences between smearing in L and 9 otherwise seem 
marginal. 

Hence the effect of detector resolution is akin to that of increasing #13, which moves 
both the minima and maxima of the peaks towards the average value of 1/2. This can 
be seen in Fig. |2U which shows the variation of the up/down events, with resolution, at 
Am 2 = 2.4 x 10 -3 eV 2 , for different values of 9 13 . It is clear, especially when compared with 
the corresponding results without resolution function in Fig. El that the distinction between 
the curves for different #13 is much reduced. In particular, it is likely that other experiments, 
for example, Double-CHOOZ, will be able to resolve #13 with better accuracy. 

We now go on to study the effect of finite detector resolutions on the extraction of oscil- 
lation parameters. We repeat the earlier calculation, where contours of allowed parameter 
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FIG. 22: The figure shows the effective width in nadir angle of a Gaussian smearing in the base- 
length, with width AL/L = 0.15, as the solid line, with axis labelled in A9° on the left. It is seen 
that a constant relative width in base-length corresponds to very small angular smearing in the 
horizontal direction and large smearing in the vertical direction (small 6 or large L). The dashed line 
conversely shows the smearing in base-length for a constant Gaussian width of AO = 5°, with the 
scale in AL/L shown on the axis on the right. It is seen that constant angle and constant relative 
widths in base-length are complementary to each other in their effects. The x-axis is labelled both 
in nadir angle and base-length L (km) for convenience. 



space were generated for an input data of up/down neutrino and anti-neutrino event rates 
in fixed L/E bins for a set of input values for (# 13 , Am 2 , 823) and focus, as before, on the 
octant resolution. We find that for resolution widths <Je/E = o^/L = 15% in both E and L, 
atmospheric neutrino (and anti-neutrino) data accumulated over 1000 kton- years is sufficient 
to distinguish a non-maximal solution from a maximal solution as well as the octant of #23 
for #13 > 8° and 823 < 39° or 823 > 51°. However, the inclusion of finite detector resolution 
severely degrades the errors on the parameters. For instance, the error on Am 2 is twice as 
large as that with an ideal detector. This is shown for two values of 813, 813 = 7°, 8°, for 
8 23 = 39° (sin 2 8 23 = 0.4) and Am 2 = 2.4 x 10" 3 eV 2 in Figs. and E0 respectively. 

While maximality in 823 can be excluded and the octant distinguished at 95% CL, only 
deviation from maximality can be established at 99% CL for the smaller 8 13 = 7° due to 
the island around the "wrong octant" solution. It may be mentioned here that a similar 
analysis has been performed in Ref. 2|- Here a slightly lower neutrino energy was allowed, 
down to E = 1 GeV, although only DIS interactions were considered. Also, the relevant 
results in this paper focus on discriminating the "right octant" solution from the "wrong 
octant" one. However, one must exercise caution in such an analysis. It is possible, as is 
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FIG. 23: As in Fig. 1151 for #13 = 9°, including finite detector resolutions. Above: smearing in E 
and 9 by Gaussian resolutions with widths &e/E = 0.15 and ag = 5°, and Below: smearing in E 
and L by Gaussian resolutions with widths (Je/E = <tl/L = 0.15. 

very clearly visible in several of the figures showing allowed parameter space with "wrong 
octant" islands, that while the exact "wrong octant" solution may be disallowed, a small 
neighbourhood of this point may still remain allowed. In fact, it is typically seen that the 
allowed island at 99% CL around the "wrong octant" solution is typically to the right of the 
central value. 

From Figs. 1213 and EH! ft is seen that a larger #13 is instrumental in suppressing the "wrong 
octant" solutions but does not shrink the allowed parameter space around the correct #23 
value. In fact, the allowed parameter space around #23 = 39° is virtually the same in 
both figures. With larger 13 = 9°, it is possible to obtain octant discrimination for larger 
#23 = 40°, but the issue of maximality can only be settled at little less than 99% CL in 
this case, as can be seen from Fig. |23 (Of course, if deviation from maximality cannot be 
established, the octant determination appears to have no meaning. What we mean here is 
that the allowed parameter space lies mostly in the first octant. The octant mirror of the 
best-fit point is ruled out, but not the maximal value. We will refer to such solutions as 
discriminating the octant but not deviations from maximality.) It turns out that both octant 
and maximality discrimination can be established at 95% CL for values of sin 2 #23 15% away 
from the maximal value. Contrast this with the result (10%) of the previous section when 
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FIG. 24: As in Fig. 1171 showing variations with #13 = 0,9°, where event rates are now calculated 
including finite detector resolution. For more details see the caption to Fig. 231 



an ideal detector is used. 

It is clear that resolution functions worsen the precision with which the magnitude of Am 2 
and 823 can be determined but do not substantially alter the sensitivity to the octant of 823 ■ 
That is, 813 = 7° (sin 2 13 = 0.015) remains the limit at which matter effects are substantial 
enough to determine the octant of the (23) mixing angle (as also the mass ordering of the 
(23) mass eigenstates, as discussed in Ref. jig]), even on including finite resolution functions, 
while the actual value of the (23) angle which simultaneously allows maximality and octant 
discrimination at 99% CL level moves marginally from 823 = 40° in the absence of finite 
resolution effects, to 823 = 39° (sin 2 823 ~ 0.4) at the lower limit of 813. 

We note that the situation is not as clean when the true value of 823 lies in the second 
octant. The muon survival probability in this case is not as well separated from that for 
maximal 823, unlike when 823 is in the first octant (see Fig. |HJ). Hence, while results for 
octant discrimination will be symmetric with the case when 823 is in the first octant, the 
issue of maximality may not be so easily settled. For example, with other parameters as 
before, and using 823 = 51°, which is the octant mirror of 823 = 39°, the "data" discriminate 
between the right and wrong octant at 99% CL, but cannot discriminate the true value of 
823 from maximality. By going farther away from maximality, for example, at 823 = 52.5° 
(and (Am 2 , 13 ) values of (2.4 x 10~ 3 eV 2 ,7°), as before), we once again have maximality 
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FIG. 25: Allowed parameter space from neutrino and anti-neutrino up/down event rates for an 
exposure of 1000 kton-years and input parameter values (#23, #13) = (39°, 7°) for fixed Am 2 = 
2.4 x 10" 3 eV 2 . The 99% CL contours are shown for an ideal detector (dashed lines) and for a 
detector with finite Gaussian resolutions of widths 15% in E and L. An island of allowed parameter 
space near the "wrong octant" solution, #23 = 7r /2 — #23 PUt = 51°> marked with a a cross, is seen. 



discrimination. 



E. A note on the inverted hierarchy 

The oscillation probabilities and hence up/down events ratio in anti- neutrinos with in- 
verted hierarchy are very similar to those in neutrinos with the normal hierarchy. However, 
the errors are about two and a half times as large due to the smaller anti-neutrino cross- 
sections leading to correspondingly smaller event rates. Because of this, a 1000 kton-year 
exposure is inadequate to address the question of maximality or octant determination of #23 . 
Both can be determined at 99% CL for an ideal detector for (#23, #13) = (37°, 9°). When 
resolution functions are included, only maximality can be established; it is not possible to 
determine the octant of #23 for any value of #23 allowed by the Super-Kamiokande results 
(see Table E}. In this, our results differ from those of Ref. By itself, this result is not 
surprising; otherwise it will imply that 500 kton-year exposure should be adequate for such 
determinations with normal hierarchy, which is not the case. 
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FIG. 26: As in Fig. [25] for 13 = i. 

solution, #23 = vr/2 - 0g put = 51 c 



'. There is no allowed parameter space near the "wrong octant" 
marked with a cross in the figure. 



V. DISCUSSION AND SUMMARY 

Neutrino oscillation studies are now moving to the precision determination of oscillation 
parameters. The most interesting questions in this field today centre around the issue of 
whether the (13) mixing angle is different from zero and its implications. The impact of this 
fundamental parameter and others were analysed in the first part of this paper. In particular 
we find: 

• #i3 sensitivity: With #13 nonzero, for energies beyond 3 GeV, there is a sharp disconti- 
nuity in the survival as well as conversion probabilities, P MAt and P efl , at the mantle-core 
boundary at nadir angle 33°. (See Fig. |2]and|nj). For small path lengths (within the 
mantle) increasing #13 simply decreases (increases) the amplitude of P MAt at the maxima 
(minima) without significantly altering the oscillation period. 

However, as the paths cross the mantle-core boundary and propagate within the core, 
the matter effects significantly modify the period of oscillations as well, for both the 
survival and conversion probabilities. In particular, the jump in P efl at the mantle- 
core boundary becomes larger and more visible with increasing #13. (See Fig. EJ). This 
important feature can be used with long baseline neutrinos for Earth tomography 
studies. 

• Am 2 sensitivity: A variation in this parameter changes the period of oscillations, even 
in the absence of matter effects. For non-zero 6x3, with the matter effects turned 
on, there are dramatic changes in the probabilities, as again both the periods and 
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FIG. 27: Allowed parameter space in (623, Am 2 ) variables. Input used was (40°, 2.4 x 10~ 3 eV 2 ), 
for #13 = 9°, where the up/down ratio was analysed using finite resolution functions in E and L of 
widths 15% each. Shown are the allowed 95% and 99% CL contours. While octant discrimination 
is possible at 99% CL, the issue of maximality can only be settled at somewhat better than 95% 
CL. 

amplitudes are dramatically altered, especially at around 5 GeV. (See Fig. |5J). At 
around 2 GeV, a substantial P efl at small nadir angles indicates a rather small Am 2 , 
Am 2 < 2 x 10- 3 eV 2 . (See Fig. IT). 

• 623 sensitivity: For # 13 nonzero, we note that as 823 increases from the first octant 
through to the second octant, the survival probability systematically decreases for most 
nadir angles in the energy range 5-10 GeV. (See Fig. |SJ). However, the conversion 
probability, P eM systematically increases as 823 increases at all nadir angles and all 
energies. This is not very significant for atmospheric neutrinos, but can be studied 
separately with long baseline neutrinos. 

Finally, the probabilities are sensitive to variations in the prem profile (within allowed 
limits) as also the CP phase. However, these dependences are rather small and insignificant 
and are unlikely to be measured with atmospheric neutrino studies of the type discussed 
here. The results discussed for CP phase in this paper can therefore be seen only with long 
baseline neutrinos when all other parameters are presumably known to good precision. 

The probabilities P w , P efl are then used to analyse the atmospheric muon neutrino events 
to determine the deviation from maximality and/or the octant of the (23) mixing angle 823 ■ 
Such dependence arises purely from matter effects as the neutrinos propagate through Earth. 
Since matter effects are different in the case of neutrinos and anti-neutrinos, we assume a 
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detector with charge discrimination capability, such as the proposed ical/ino detector, to 
heighten the sensitivity to such matter-dependent effects. Moreover, all matter terms are 
proportional to sin 2 # 13 so we assume that this (13) mixing angle is different from zero. 

We study the up/down events ratios, where by up (down)-neutrinos, we mean neutrinos 
arriving at the detector from below (above), so their nadir angles range from 0-90° (90-180°). 
Analysis of ratios of events rather than events themselves significantly reduces errors from 
overall normalisation of fluxes and cross-sections; the former can be as large as 30% and the 
latter around 10%. Smearing in energy E and base-length L by use of Gaussian functions is 
used to simulate finite detector resolutions. Typical relative widths of 15% are used for both 
energy and base- length. The allowed parameter space obtained on fitting up/down neutrino 
and anti-neutrino events ratios in any two of (Am 2 , 823, #13) is considered. 

Since the up/down events ratio has very different dependence on 823 and #13, in principle, 
they can be simultaneously determined from such studies. The proposed detectors such as 
ical/ino with charge identification capability may be in principle suitable for determination 
of these parameters. In practice, however, these detectors are not well suited for precision 
determination of # 13 with atmospheric neutrinos. A precise measurement of this parameter 
is likely to be made, for instance, by the Double-CHOOZ experiment. 

We summarise below our observations on the simultaneous determination of |Am 2 | and 
623 from an analysis of the event rates at these detectors with focus on the determination 
of 623- We distinguish three scenarios. The best case is when both deviation of 823 from 
maximality as well as its octant can be established. In some cases, a maximal value of 623 is 
disallowed, so deviations from maximality can be established but the octant discrimination 
may not be possible. The third is where the best-fit value lies in one of the octants and the 
region in parameter space around the mirror to the best-fit value in the other octant is ruled 
out at the precision under consideration; however, the maximal value is not ruled out at this 
precision. In such a case, the allowed parameter space still lies mostly in one octant and 
hence we consider that we have octant but not maximality discrimination. 

• If #i3 is known precisely in the near future, as is likely from Double-CHOOZ, then in the 
energy range E = 5-10 GeV, where matter effects are largest, the data from ical/ino 
will be able to study deviations of 823 from maximality as well as determine the octant 
of this angle, provided 813 > 7°. 

• It must be emphasised that the octant discrimination is more easily done than es- 
tablishing deviation from maximality for larger 813 and the reverse is true for smaller 
&i 3 when islands of allowed parameter space begin to appear near the "wrong octant" 
solution. Also, values of 823 in the first octant are more easily distinguished from max- 
imality than those in the second octant. This result is in contrast to those obtained in 
Ref. 0. 

• In particular, deviations from maximality and octant discrimination to 99% CL can be 
obtained if sin 2 823 < 0.4 and sin 2 813 > 0.015. These studies used standard Gaussian 
resolution functions with widths 5L/L = 5E/E = 15% to smear the events. Similarly, 
we must have sin 2 823 > 0.63 for corresponding results in the second octant. 

• In an earlier paper ^6[, it was also shown that the same processes are also eminently 
suited to determine the (23) mass ordering. Both these determinations need large 
exposures of roughly 1000 kton-years as well as, crucially, the charge discrimination. 
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• As discussed in |l6|, the issue of determining the (23) mass ordering and hence es- 
tablishing the neutrino mass hierarchy is best done using the difference asymmetry 
defined in Eq. which is the difference of the up/down events ratios with neutrinos 
and anti neutrinos. For the octant discrimination that is the crux of this paper, the 
relevant observable is in fact the sum of these two ratios. 

• The same experiment can therefore study both these questions, while requiring large 
exposures, 1000 kton-years, in both cases. Hence, studies of neutrino oscillations with 
atmospheric neutrinos, while being difficult, are probably the only source of precision 
measurements, at least until very large megaton detectors and/or neutrino factories 
become a reality. 

Even so, it is important to point out that the determination of the hierarchy is likely to be 
relatively easier than the octant determination. This is because, as seen from Fig. the 
octant effect rides on the hierarchy issue as a sub-dominant effect. 

Another way to see this is that the octant determination is dominated by the (anti) 
neutrino events ratio in the (inverted) normal hierarchy, which are the relevant sectors where 
matter effects dominate. Since the statistics is smaller by half for anti-neutrinos for the same 
exposure, the significance of the results deteriorates in the case of inverted hierarchy. 

The bulk of the results presented in this paper therefore pertain to the normal mass 
hierarchy. Results of similar significance can only be established with the inverted mass 
hierarchy if the exposure is at least twice that for normal hierarchy. Hence, such detectors, 
with exposures of 1000 kton-year or so, may be able to settle the issue of mass hierarchy 
but, if the ordering is inverted, the issue of maximality of #23 may remain an open question. 
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VI. APPENDIX 

One of the earliest analytical methods for the calculation of oscillation probabilities with 
variable matter density is in Ref . ■ The oscillation probability was derived assuming mat- 
ter to be made up of a series of slabs through which neutrinos and anti-neutrinos propagate. 
Each slab has smoothly varying density, but the density itself has discrete jumps at the junc- 



tion of adjacent slabs. In a recent paper, Akhmedov et al. |21[, have provided an excellent 
collection of approximate analytic formulae for the neutrino oscillation probabilities. Exact 
analytical formulae have also been derived in the case of vacuum |22j and for matter with 
constant density slabs 2^ . Though complicated, exact analytic formulae have been derived 



for non-uniform density with linear [2J| and exponentially |25( varying density. Approximate 
analytic formulae with varying assumptions have been derived in a number of papers j2^|. 

Here, we use a standard Runge-Kutta solver to numerically propagate the neutrinos 
through Earth's matter, using the prem Earth density profile for a spherical equivalent 
Earth with radius Re = 6371 km. We outline some details about the numerical calculation. 
We also highlight how results from an algorithm using constant density slabs differ from 
those with the prem profile. Our technique is to numerically evolve the flavour eigenstates 
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using the equation, 



JL(UM>Ui + A)[> 



(6) 



where A is the diagonal matrix, diag(A, 0, 0) and [u a ] denotes the vector of eigenstates, u a , 
a = e, /i, t. As usual, U is the MNS mixing matrix defined in Eq. |21 M 2 is the mass-squared 
matrix with the diagonal piece proportional to m\ removed: M 2 = diag(0, 821, £31). Note that 
in a constant density slab approximation, the mass eigenstates are propagated, including the 
"sudden" jumps across the density discontinuities. 

As mentioned in the text, the chief difference between the constant density approximation 
and the prem profile lies in the resonance effects. This can be seen from Fig. |2H where the 
results of using the prem profile in our calculations, and the nuance [ItJ result for the same 
parameters, using constant density slabs, is shown. Here we have set the parameters 621, 
Am 2 (normal hierarchy), 8 2 i and 623 to their best-fit values as given in Table and set the 
CP phase to zero. We use (9 13 = 9°. For a low value of E = 2.51 GeV, where resonance occurs 
in the core, the constant density slab of nuance does not show resonance since the precise 
density value needed for resonance does not occur. Of course, matter effects are present and 
are large; however, this difference causes the two curves for the neutrino survival probability 
to begin to separate in this region, as can be seen from the top left panel of the figure. It is 
seen that the anti-neutrino probabilities, which are relatively insensitive to matter effects in 
the normal hierarchy, however, match exactly. 
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FIG. 28: The muon neutrino and anti-neutrino survival probability as a function of nadir angle for 
different energies. Shown are the results from an exact numerical method using the prem Earth 
density profile (solid lines) and a constant density slab model from nuance [~Lt] |. 
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At larger energies, E = 6.31, the "missed" resonance occurs in the mantle itself. Hence, 
deviations between the two curves are seen at almost all zenith angles. The difference can 
be up to 10-15%. Note also that the prominent effect of core-crossing, which occurs at 33°, 
can be seen clearly in both curves. Again, the anti-neutrino probabilities match. 

We have also checked that, by taking smaller and smaller slabs, and approximating the 
prem profile as closely as possible, the results from the constant density slab approach those 
using the exact Runge-Kutta solver with prem profile. However, the resultant increase in 
number of slabs is quite large. 
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